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ABSTRACT:. , , 

v* 

A model is defined wherein corrective action may be accounted for in im- 
proving the estimation of reliability over the usual nominal success ratio. 
Probabilities for correcting any one of K failure modes which may arise are 
assumed known within the structure of a multinomial sampling procedure. Mean - 
reliability is defined as a function of the unknown probabilities attached to 
the failure modes, the problem being to estimate this mean. Other measures 
of current reliability are defined. Three different estimators of mean relia- 
bility are defined and analyzed from the point of view of unbiasedness . 

Explicit expressions for the bias are derived and compared numerically for 
a wide variety of choices for the unknown parameters . Several problem 
areas for further research are identified and partial formulations of some 
of these are discussed . < 1 
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UNCLASSIFIED 



ESTIMATING MEAN RELIABILITY GROWTH 
1 . Introduction 



A problem of considerable importance in current reliability studies is 
that of accounting for changes in reliability that result from various 
actions designed to modify a part or a system . Such modifications may 

range from design changes in the early states of development to corrective 

; * - 

action taken to remove modes of failure that habe been pl^Served in a test- 
s’^ 

ing program at a later stage of development. Any modajf^p which it is 
assumed that such modifications never decrease the teliability (probaba- 
bility of successful operation) has come to be titled "reliability growth." 

Despite the importance of the problem and the interest in solutions, 
very little published research on the topic of reliability growth exists . A 
brief list of some papers on the subject is given in the bibliography. In 
one reference [3] the writer,’ along with others, has developed one model 
to account for reliability growth and several estimations problems are dis- 
cussed there . This same model is the main concern of the present report 
and is repeated here for the sake of completeness . 

Suppose that an item or a system is to be tested apd each test may 
result in success with probability p^ or exactly one of l K fixed, but 

otherwise unspecified, modes of failure. The parameter P is referred 

f?* ° 

to as the initial reliability and we denote the probability of failure of type 















& 



K 



i by q. for i = l, 2 , ...,K. Thus , p + L <3, = 1 and if we assume that 
i ° i=l 1 

N fixed, mutually independent tests are to be performed, the underlying .1 



probability model is that of the multinomial distribution with parameters 

N, p , q. , . . . , q . Accordingly, we denote the number of observed 
OIK. 

successes in N tests by N while N. is used to denote the number of 

o 1 

observed failures of type • i . Thus, N , N. , ..., N are (marginally) 

, O I K i < 

. N . 

binomial random variables subject to the restrdction £ N. - N i ; 

• ' : . . i=0 A • ' 



/ •< 



i . . 

. V j, ’ 
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By fixing K in the preceding formulation it is tacitly assumed that 

jV* j 

no new failure modes are ever Introduced. Also, it is Assumed that no 

• a** 

corrective action is to be taken until all N tests are performed so that 
our procedures will be based on fixed sample size experiments . Having 
performed N tests , it is assumed that each observed failure mode can be 
classified as to type and that ah attempt is then made to remove that mode 
of failure. However, it is not assumed that a failure mode is necessarily 
removed once it is observed . Indeed, subject to experience with the item 

, 

or system, it is assumed that there is a known probability a of removing 

th ^ 

the 1 mode of failure given that corrective action is taken which in turn 

is always taken if and only if the failure mode is observed . 

Under the above model, there are at least three measures of current 

reliability that are of interest each being appropriate at possibly different 

stages of development. First, and the most natural, is the actual current 

reliability, say R , which exists after the tests and after; the corrective 

u 

action takes place. Prior to testing, R is a random variable of course and 

may be written as follows* Let y = 1 if N > 0 and 0 otherwise, so that y. 

11 th 1 ; 

is a random variable that accounts for whether or not the i failure mode 

occurs . Also, let x = 1 if corrective action on the i** 1 failure mode actually 

removes that mode of failure and 0 otherwise. We may then write , ,, 



K' 

<i •»- R ° p 0 + I wi 

1=1 



In this form we see that current reliability is the initial reliability plus 
any failure probability that has been observed and actually removed. 
Reliability is thus not increased by a particular mode if either it is not 

■ >4 , 

observed or it is observed but not removed . 

i . ■ i > 






The quantity R which we have defined above is of primary interest 

jjMS * 

after the complete testing program when the actual current Reliability is 

j - 'U 

desired. One perfectly straightforward way of estimating ^ Is to perform 

I i i 

N additional tests observing N successes and use the usual success 
• • ° » 
ratio N q /N as an estimate. It this is feasible, such a procedure certainly 

is on safe grounds statistically speaking. If, however, the cost or availa- 
bility of items prohibits this direct approach , it is necessary to adopt a 
cruder measure of current reliability and use the results^! the N tests to 
draw inference about the amount of reliability growth. One such measure 

would be the conditional mean of R , conditioned on the observed values 

* 

of N J# i = 0, 1, . . . / K. This conditional mean, denoted p , is derived in 



v • 

y» 

. '% 



[3] and is given by 



K 



(1.2) p' 



= p o + 



l y i a i q i 



i=l 



where y^^ is defined above . Such an average has an advantage in that 

averaging is taken with respect to whether or not corrective action is sue*;, 

cessful as a function only of the failure modes that are observed. In this 
* 

sense, p Q is not the true current reliability, that is success probability, 
as it is erroneously referred to in [2] but is already an "average" relia- 

•k 

bility. The analysis of both R and p is the main concern of Report No . 2 , 

of this study [5] and will not be discussed further in this report. 

A third measure of current reliability is the unconditional mean of the 

* 

current reliability (which is the same as the expected value of p^ ) and is 
an "average" taken over all possible outcomes of the experiment. This 
measure of reliability is relevant before testing and before corrective action . 
Such a quantity would be suitable for assessing the potential gain in relia- 
bility to be derived from a corrective action program . Being a true parameter 
in the strict sense of the word, it lends itself quite well to standard statis- 
tical estimation tools. It is shown in [3] that this mean reliability, denoted 

* . . 

p, is given by the formula, ‘ ; • > 



3 



>‘v* 



, N 



l 



K K 

(I. 3 ) n = P Q + l ajq, - l (1-q/ 
i=l i=l 

References [2] and [3] address themselves mainly to the problem of find- 
ing estimator! for P under the conditions stated in the above model . 

1 . , f 

Several estim^ors are defined in both references and various properties 
(of both a positive and a negative nature) are discussed. Three of these . 
are of interest in the present study and, for the sake of definiteness, the 
notation of [3] (which does not always agree with that of [2] even for the 
same quantity) will be adopted . 

The maximum likelihood estimator for p is denoted p and is defined 

O 

quite simply by, 



(1.4) p = ££p + 
6 N 



K 



1=1 



K 



-JV & (1-I1 ) 

1 N . , 1 N ^ W ^ 
i=l 



N 



An exact expression for the expected value of p^ was not available in 
[3] although approximate expressions were derived. This created some 
limitations in comparing p^ with other estimators on an equitable basis . 
One of the purposes of the present study is to resolve this problem of 
exact expressions for the moments . The results are presented in the 

Vi 

sections to follow. 

Another estimator, derived in [3] to meet the requirements of unbiasedj 
ness, is denoted p,_ and is- given by the expression, 



(1.5) 



P -ik 
p 5 N 



K N-l 



- n ^ ^ a i Q&) . 

i-lj' =1 , . , 

The corresponding bias of p^ , defined by b(p_) = E(p )-p is given quite 



simply by 



K 



(1.6) b(p 5 ) = (-1) 



N I -a 



N+l 



i=l 



4 



It should be noted that p is not unbiased and, indeed, it is shown in 

0 

[3] that no unbiased estimator for p, exists. However, the bias for p 

1 o 

may be so small as to be negligible and this will be Verified in Section 3 
to follow . 



For reasons peculiar to the Navy, a third estimator for p. has been 

adopted by Special Projects and is extensively discussed in [2] . This 

estimator is here (and in [3]) denoted by p_ and is defined by, 

b 



(1.7) p c = 



N 

o 



, — + Y Z t where Z = 1 ' 

6.. n • * Zj i N i 1 0 



a. if N i > 1 



otherwise 



The moments of p are easily computed and the bias is accordingly given 

\ O ■ 

by 



K 

(1.8) b(p 6 ) = a.q.^d-q.) 

i=l 



N-l 



r i 



It should be observed that the bias of p_ is always negative so that p_ 

b b 

is a "conservative" estimator. However, it may be that the amount of bias 

is serious enough to discredit conservatism in some cases. Several samples , 

admitting a wide variety of choice for the various parameters in the above 

model, are delineated in [2] . However, a simulated version of the random 
★ 

variable p Q is used as a reference point rather than p. , no results regard- 
ing Pj. are presented and, for .reasons mentioned previously, the moments 
of Pg are omitted from discussions . An examination of the behavior of all 
Clf these elements for the same examples constitutes another portion of the 
present study. Results are summarized in the following sections. 



2 . Maximum Likelihood Estimator 

One of the common features of the two estimators p and p defined 

* 5 6 

in Section 1 is that no credit is given to failure modes that occur only once. 
This is easily seen by examining equations 115 and 1.7 where, if N^O 
for any given i, that term involving vanishes and therefore does not 
affect the value of the estimator. For small sample sizes, this is somewhat 

5 - ' • 



U 



undesirable since such a procedure appears to ignore some of the infor- 

mation in the sample. This may be the price one pays fpr attempting to 

avoid overestimating p which was a requirement constantly kept in mind 

in deriving p_ and p_ . It should be noted that the maximum likelihood 
o b 

estimator does not have tljis particular feature and every occurrence of a 

m , * t • 

failure mode is allowed to increase the estimate of p, . To see how the 
bias is affected we first compute the expected value of p . 



.Viv 



Since 



we may write 



N 

o 

P 3 N 



N N N •' N k 

OrnD-.k-a )«**• 

"J •. 

K , „ K N •“i- - . 

+ Y a ^ - f a. N i Y (^"(-l) 15 N i 

i k 1 N A T 1 



K N 



-v-l Z »'■, COJ 

N i=l k=l • N 



k+1 

i 

k+1 



Thus ,’ from linearity, 

K N 



E(p 3> = p o • I I H)k -,(f > 0j ) 



i=l k=l 






k+r 



But for i=l, 2‘, . K, N.-.is binomial with parameters and N so 



that, for each K=l,2 : , ..., N, 

N 

/■ k+lA V . k+1 ^N\ i 

E ( N ! )‘I‘ 

J = 0 

Substituting in the preceding expression, 
K N N 

, ' J 

E 

' A' ‘ O Z_. Zj _ 

j=0 



N-j 



.V.f 



• *V . v' v HYf) N k , k+1 

< P 3> “ P o- l l “i 0- q 0 (cO 1 

i=l k=l 1=0 N* +1 v 






r 



. 0 



" p o + I I a i (j ) V O-'O 1 I(k)C^) 

1=1 i=0 k=l 



k+1 



N ^+1 N 

But . Z ( ” ) CA ) i-K'-i) s ° that ' 

k=l 



K N 



E <P 3 ) 



i-1 J = 1 



Also, for j ^ 0 so we may write, 

N v - j y -1 J 



K N 



N-J 



*<p 3 > - Po + 1 I *i O < 0-0 0-<¥> N ) 

1=1 j=i 

• i 

= r 0 44(?i>K^r-i Ugv^T'q 

i=l j=l i=l j=l 



NjJ 

N 



After some minor s implications , we finally write 

(2 .1) E (p 3 ) = P Q + 1 aft - 1- l a, ("** ) (U,*)" ‘ ’(^ ± 'j 

1=1 i=l j=0 

A 



N-l-j 



N 



The bias of p is then immediate and may be written as , 
o 

(2.2, [l^CT0a< H '(^') N ] 

i=l j=0 

Before examining the magnitude of the bias b(pg) in comparison with other 
estimators, it is possible to provide an alternative form of (2 .1) using 
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Stirling numbers of the second kind . This form may be more appropriate 



for some purposes than the one given. As before, finding E(pJ reduces 

th " 3 

to being able to write the general m moment of the binomial distri- 



bution explicitly. The expression of the latter in terms of Stirling numbers 

, ’'t, 

does not seem t<p be widely recorded and is stated below as a theorem for 
the record. With regard to the proof, we follow the nqtation of [4] so 



■!; (f) ' k* 

that, for positive integers k and r, k v = k(k-l) (k-r+1) =^— if 

,k th 



k s r and is zero if k < r; ^ denotes the r 111 Stirling^umber of the 
second kind of order k . 






Theorem Let X be binomial witl^ parameters n and p 



m 



Then, E (X™) = 



n W . / 



m 



p for every positive integer, m . 



r=l 



Note: If m> n, E(X m ) = ^ p r since n^ =0 if r>n . 



r=l 



Proof : Let m be any positive integer. By definition , 

n 



eix") = £G?> k i n - k y 



k=l 



m 



r-> 0 m ( r ) 

= ) «^r k v so that , 



But, k 



m 



r=l 



n m § 

<A-l K2)p k - n - k \/r 









k=l r=l 



.(r) _ 



Since k = 0 if k < r we may simplify further to , 
m n 



.. > ‘ '< 1 . 



r=l k=r 



m 



n-r 



■ .-l " <r X / 1 ( n ; r ) p' ? n 



-r-of 



r=l \ 



i o/=Q 






■i 



q .e .d . 



m n m 

= T „< r » $ P r 

■ k r 



To write E (p ) in terms of Stirling numbers we expand (1 .4) to obtain, 

jf' 



No 

p 3 N 



K 



K 



, N 



+ PS ' l so that, 

1= i ‘=1 n™ 



K 



K 



(2.3) E (p 3 ) = P 0 + l ap. ' £ ' * [ N i (Vi^f ] 

i=l i=l N 






N 



Now let Z. = N. (N - N.) and Y. = N - N. so that 

i l i i i 

\ 

Z = (N-Y.) Y. 1 ^ = NY,^ - Y.^ + * , Since N. is binomial with parameters 

• • • , 1 » 1 ‘ a 1 j i 

1 1 • ; '>• ; •• f - ■ > ' i m . 

• k * t .* ■ • •' * 

N and q., it follows that Y. is binomial with parameters N and 1-q. . By 

1 • • . ; s. i • _ \ , . ' .>> \r. * \ ly t 1 

the theorem , * -• : - U y . ' ■ f >•• 



R 



E (Z A ) =NE(Yj' ) - E (Y, 



N 



i=l 



. ; . * s .* > 



n N nN+1 

'I [NN <r> 4 r * O'Oi 7 - N ’ *1 (>-^) r ] 



r=l 



’ S 1 
s 



4 



.< j 



r=l 

,N+1 /)N 



(V? =cj> +r jt r < see C 4 3 P .17) 



<V?; 

' tO 



Since , 

numbers of the same order whence , 
N 



we can simplify to Stirling 



N 



N 



j .< i . 

‘ ‘i ...I « ‘ >: . 



E (Z.) = £ N (r) (l-q^ [ (N-r )<^ r "^V-i ] . 

r=l . '■ \ :: ■; 



Substituting in (2 .3) we finally obtain , 

K K N 

(2 .4) E (p 3 ) = p Q + 



N . N 



twi : I-jm N (r) (l-qJ[(N-r)^ r -Jr+1 ] 
i=l i= 1 r=l' 1 • 
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Returning to the bias of given in (2.2) it is difficult, because of the 
complexity of the expression, to make general statements . Certainly p 
may both overestimate as well as underestimate \i . A simple example 
shows this. Suppose N=2 , K=l, and Now, if q^ = .9, then pt= .991 

while if q^ = .1 then m- = .919 In either case, ,E(pg) js given by .975 
so that in the first case (p 1 = .9) , b(p^) .= - .016 and, in the second case • 
b(pj = + .066. More cases are treated in the next section. 

v 

3 . Numerical Comparisons 

To gain further insight into the results of the last section as well as 
to compare these results with those previously obtained in [2] and [3], 
it was decided-to examine special cases numerically. For this purpose 
the examples documented in [2] were used. Such examples allegedly 

V 

cover a wide variety of cases that are of practical significance. The tabu- 
lated results may be found in the appendix. Section 5. An example is de- 
fined by specifying the parameters K, p , q. , q 9 , ..., q-' . Nine such 
specifications are given. However, in each example, the parameters 
a^ , a^ , . . . ,. a^ as well as N are further specified to provide fifteen 
cases in all. In reality, then, 135 examples are treated in the appendix. 

For each of these examples p, the moments of each of the three estimators, 

f v, 

p of p c , p c are recorded as well as the bias in each case. In addition, 
o o b " A ; 

the value of p determined by computer simulations in [2] is given for ? 
o 

each example . 

* 

We previously remarked in Section 1 that p Q , the conditional mean of 

the true current reliability is, prior to the experiment, a random variable. 

* 

Even after the experimental results are known, moreover, the value of p^ 

still cannot be determined because of the unknown parameters p Q , q^ , . . . ,q^ 

which enter explicitly in its formula . It is shown in [3] that the variance 
* 

of p converges to zero as N becomes infinite. Hence, for large N, 

° * 

the values of p Q (whatever the experimental outcomes) and p, its mean/ 
should not be significantly different . The tables of Section 5 show that 



• ' • ■ : 1 
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these two quantities differ by very little even for moderate values of N-’— 

I 

at least for the examples treated. What this means, of course, is that 

any estimator we choose for estimating p, a parameter, can effectively 

* 

be used also as a predictor for p , a random variable. 

> o 

As for the maximum likelihood estimator, p^, the tables reveal that 
the bias is positive in practically every case investigated. In some cases. 
Examples 3 through 8, the amount of positive bias is s<=pdous enough to 
make its use doubtful. Of course, we are speaking hef|i j^y of unbiased- 
ness as a criterion for choice. Recalling the original problem, one is 
attempting to take credit for corrective action in updating reliability over 

•the initial state of nature p . Positive bias indicates a tendency to take 

o 

more credit than is due and such optimism can be very misleading as to 
the potential worth of such a testing program . From this point of view, p 
has little to offer the experimenter. The result is not too. surprising since 
maximum likelihood estimators tend to be biased. Moreover, it is difficult 
to justify the maximum likelihood criterion, for which p. is the optimal 

u 

choice, as one to adopt in the present circumstances . 

As far as unbiasedness alone is concerned, it is here reiterated as in 

[3] that p is "effectively" unbiased. Indeed, in every single example 
o 

treated, the bias of . p is zero to three decimal place, computation. Not 

O ' 

one case arose where the result was different from zero. Such a situation 
is not surprising for large values of N as brought out in [3] but for small 
values of N the same result is somewhat surprising and helps support p 

o 

as an important contender for use as an estimator for p. . 

It was anticipated that p_ would underestimate p, since it was defined 

b 

in such a way as to have this property. The amount of bias is somewhat 
serious in several of the examples (notably 1, 2, 4, and 8) . As remarked 
previously, the price for conservatism may be too high. Certainly we wish 
to avoid overestimating; at the same time we should not want to be unduly 
severe so that we certainly wish to take credit for corrective action when 
such credit is due. .* ■ ; 



* < 
/- 

’<* ' 





v . 
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As a final remark we note the following interesting result in the 
examples. As the a^'s decrease, it is noted that for fi^ed N, the bias 
approaches zero (from either side) . This means that as our ability to 
remove the cause of a detected failure decreases so too our tendency 
to overestimate (or underestimate, as the case may be) decreases. 

♦ 

4 . Topics for Further Study 

It is concluded that the matter of unbiasedness ijor the model treated 
in this report is settled. P,_ is preferable to the three estimators ex- 
amined and certainly p^ should be rejected on this basis .. However , 

£s previously remarked, unbiasedness is but one criterion. It is well 
known that a biased estimator is preferable over an unbiased one if the 
variance of the former is sufficiently smaller than that of the latter. This 
suggests adopting mean Squared error as a criterion and comparing p , 

’ O 

p c and p on this basis . 
o b 



In [3] the .variance for p has been derived and is given explicitly 

o 

at least up to higher order terms . No such expression is yet available 
for p although some (umpublished) computer simulations carried out in con- 

O if* 

nection with [3] indicate that the variance of p deceases rapidly with 

N. Clearly, the variance for p can be written down along the lines of 

3 *>* ■'/ k 

the first moment as derived in Section 2 although the algebra involved 
may be somewhat unwiedly. In any event, numerical values can certainly 
be obtained for such as the examples treated in this report. With such tools 
at hand, the three estimators could then be compared on a mean squared., 
error basis . ’ 

Since ^ is a well-defined function of the unknown parameters involves, 
another problem suitable for investigation is that of finding a Bayes estimator 
for (j. , Some a priori assumptions about p , q. , q would of course 

. O 1 K. 

have to be made and the results judged accordingly . Such an estimator should 

then be compated with the other candidates as to unbiasedness, mean squared 

. . .■ / 

error, etc. 
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As yet, little progress has been made within this model in the 
direction of confidence interval estimation. In no small part, this is 
due to the complete lack of distribution theory with regard to the esti- 
mators treated. 'It would be most desirable to study the problem of find- 
ing a lower one-sided confidence interval for u . Even approximate re- 
sults would be bepeficial to the present state of the art. 

Still another problem worthy of investigation is a re-examination 
of the model itself. In spite of its reasonableness, some aspects of the 
model are somewhat confining. Most notably, the ma|$g|~pf allowing 
failures to accumulate until all N tests are performed may be intolerable 
in some practical situations . It may be far more reasonable to stop test- ' ( 
ing as soon as a. failure is observed, take the necessary corrective action, 
then proceed as before until the next failure occurs . Such a program of 
testing would thus involve several stages. In a given stage, the sample 

obtained would be a sample from a geometric distribution (having observed 

( 

Bernoulli trials to first failure) but the parameter changes from one stage 
to the next if corrective action is successful. Again, various quantities 
related to the growth in reliability could be examined under this model . 

A model similar to that just outlined is presented in a report [1] 
which appeared recently in the literature . A brief examination of this re- 
port reveals several shortcomings which will need to be overcome before 

"'dpi' 

the usefulness of the results can be assessed. In any case, the work pre- 

• .•*'*!•**. / 

sented there should be more closely examined if further study along the 
lines presented above is pursued. ^ 

5 . Appendix 

The tables to follow summarize the numerical results which are analyzed 
in Section 3 . The tables are self-explanatory with all of the notation con- 
sistent with that previously adopted in this report. The examples were 

limited to those available in [2] in order to avoid computer simulations 

* 

needed for evaluating p Q . Otherwise, any number of further examples may 
be defined as in the tables and the corresponding entries easily computed . 
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EXAMPLE 



1 









o , 

• 

III 

-«~i 

<0 


a ^ = 0.8 


S , = 0 • 6 

1 


N 


5 


10 


25 


50 


100 


5 


10 


25 50 100 


5 


10 


25 


50 100 


* 

P o 


.434 


..649 


.928 


’993 


1.00 


.370 


.549 


.748 


.815 


.820 


.313 


.431 


.594 


.635 


.646 


M - . 


.469 


.686 


.935 


.995 


1.00 


.395 


.569 


.768 


.816 


.820 


.321 


.452 


.601 


.637 


.646 


E ( p ?|) 


.786 


.836 


.937 


.986 


1.00 


.649 


.680 


.769 


.810 


.820 


.511 


.542 


.602 


.633 


.646 


b ( p 3 ) 


.317 


.150 


.002 


# 

.007 


0 


.254 


.120 


.001 


# 

.006 


0 


.190 


.090 


.001 


* 

.004 


0 


E(p 5 ) 


. 46 £ 


.686 


.935 


.995 


1.00 


.395 


.569 


.768 


.816 


.820 


.321 


.452 


.601 


.637 


.646 


b ( p 5 ) 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


E(p 6 ) 


.406 


.651 


.928 


.995 


1.00 


.348 


.541 


.765 


.816 


.820 


.286 


.431 


.597 


.637 


.646 


,b(pj 


W~ 

Me 


# 

.035 


if 

.007 


0 


0 


F" 

.047 


w~ 

.028 


ir 

.005 


0 


0 


r 

.035 


If 

.021 


w~ 

.004 


0 


0 



# - indicates negative value 



TABLE 1 



! 



EXAMPLE 2 



K = 10 p Q = .10 

q l =q 2 = ' 20 q 3 =q 4 =<5 5 = - 10 , q 6 = ••• =q l0 = - 04 





a. = 1.0 

l ’ 


a. = 0.8 
i 


=0.6 


N 


5 


10 


25 


50 


100 


5 


10 


25 50 100 


5 


10 


25 


50 100 


★ 

P o 


,519 


.718 


.902 


.974 


.997 


.451 


.589 


.747 


.796 


.816 


.343 


.468 


.584 


.622 


.635 


P 


.523 


.719 


.905 


.972 


.997 


.443 


.596, 


744 


.798 


.817 


.357 


.472 


.583 


.623 


.635 


E(P 3 ) 


.80^ 


.856' 


.936 


.976 


.994 


.663 


.705 


.769 


.800 


.815 


.522 


.553 


.602 


.625 


,636 


b(P3) 


.275 


.136 


.031 


.004 


.003 


.220 


.109 


,025 


.002 


# 

.002 


.165 


.081 


.019 


,002 


002 


E(p s ) 


.529 


.719 


.905 


.972 


.997 


.443 


.596 


.744 


.798 


.817 


.357 


.472 


.583 


,623 


,638 


b(p 5 ) 


0 


0 


0 


0 


6 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


E(p 6 > 


.469 


.692 


.899 


.971 


.996 


.396 


.573 


739 


.797 


.817 


.322 


.456 


.579 


623 


,638 


b>(p 6 ) 


.060 


.027 


.006 


F~ 

.001 


.001 


.047 


t = 

.023 


.005 


¥~ 

.001 


0 


;# 

.035 


# 

.016 


# 

.004 


0 


0 



# - indicates negative value 
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I 



EXAMPLE 3 







a . = 

i 


1.0 






a i 


s 0 


.8 






a i 


s 0 


.6 




N 


5 


10 


25 


50 


100 


5 


10 


25 


50 


100 


5 


10 


25 


50 


100 


* 

P o 


.139 


.176 


,282 


.426 


.636 


.132 


.162 


.245 


.358 


.533 


,124 


.146 


,210 i 


,297 


.42J 


M- 


.140 


.178 


,282 


.427 


.636 


.132 


.162 


.246 


.362 


.528 


.124 


.147 


.209 


.296 


.421 


E(p 3 ) 


.713 


\ 

.703 


,719 


.753 


.814 


.590 


.583 


.595 


.623 


.671 


,468 


.462 


.471 


,492 


.526 


b(P3) 


.573 


.525 


,437 


.326 


.178 


.458 


.421 


.349 


.261 


.143 


,344 


.315 


.262 


.196 


,1Q7 


E(p s ) 


,140 


.178 


,282 


.427 


.636 


.132 


.162 


.246 


.362 


.528 


,124 


.147 


.209 


.296 


.421 


b(p 5 ) 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


E(p 6 > 


132 


.170 


,276 


.422 


.632 


.126 


' • t"' 

.156 


.240 


.358 


.526 


,119 


.142 


.205 


,?93 


,419 


b(pj 








# 


# 


# 


# 


# 




# 


# 


# 


# 


[# 


# 


008 


.008 


006 


.005 


.004 


.006 


.006 


.006 


.004 


.002 


,005 


.005 


.004 


h 003 


,002 



# - indicates negative value 



K = 100 Pq = .10 



q i = q 2 = V" q !00 = - 009 




TABLE 3 
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/ 



EXAMPLE 



K = 100 P 0 = .10 

q l =q 2 = - 20 q 3 =q 4 =Q 5 " - 10 q 6 * ' • ’ “ q 10 = - 004 q n = • ' ' = q l00 = 





a. s 1.0 
i 


a A h o.8 


a = 0.6 


N 


5 


10 


25 


50 


100 


5 


10 


25 50 100 


5 


10 


25 


50 100 


* 

P o 


.502 


.650 


.77.7 


.819 


.840 


.426 


.545 


.653 


.676 


.691 


.337 


.437 


.515 


,531 


^544 


P 


.494 


.657 


.788 


.819 


.839 


.415 


.545 


.650 


.675 


.691 


,336 


.434 


.513 


.532 


,54^ 


e(p 3 ) 


.796 


.841 


.905 


.925 


.936 


.657 


.693 


.744 


.762 


.769 


,518 


.545 


.583 


,597 


602 


b(p 3 ) 


.302 


.184 


.117 


.109 


.097 


.242 


.148 


.094 


.087 


.078 


,182 


.111 


.070 


,065 


0 58 


e(p 5 ) 


.494 


.657 


,788 


.819 


.839 


.415 


.545 


.650 


.675 


.691 


,336 


.434 


.513 


,532 


544 


b(p 5 ) 


0 


0 


0 


0 


0 


0 


0 


0 


0 


.0 


0 


0 


0 


0 


0 


E(p 6 ) 


.441 


.634 


.785 


.819 


.839 


.373 


.527 


.646 


.675 


.691 


,305 


.420 


.511 


531 


.544 


b(pj 


# 

.053 


.023 


#■ 

.00c 


0 


0 


.042 


.018 


.002 


0 


0 


# 

,031 


# 

.014 


* 

.002 


T~ 

001 


0 



# - indicates negative value 
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EXAMPLE 



5 



K = 100 p Q = .10 

W3 * ao V - 003 q 5 = * * ♦“‘<10 “ - 020 q n = q ioo 



•xm 



= .005 



! . 
Me 





a. = 1.0 
i 


a^ s? 0.8 


a i s 0.6 


N 


5 


10 


25 


50 


100 


5 


10 


25 50 100 


5 


10 


25 


50 100 


* 

p o 


.246 


.351 


.503 


.599 


.714 


.213 


.304 


.418 


.499 


.586 


.184 


.245 


.338 


.397. 


*464 




.246 


.339 


.479 


.575 


.682 


.216 


.292 


.403 


.480 


.566 


.187 


.244 


.328 


.385 


566 


E(p 3 ) 


.718 


.728 


.770 


.805 


.840 


.595 


.603 


.636 


.664 


.692 


.471 


.477 


.502 


.523 


692 


b(P3) 


.472 


.389 


.291 


.230 


.158 


.379 


.311 


.233 


.184 


.126 


.284 


.233 


.174 


.138 


126 


E(p 5 ) 


.246 


.339 


,479 


.575 


.682 


.216 


.292 


.403 


.480 


.566 


.187 


.244 


.328 


.385, 


566 


b(p 5 ) 


0 


0 


0 


0 


•o 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


E(p 6 ) 


.221 


.324 


.474 


.572 


.681 


.197 


.279 


.399 


.478 


.564 


.173 


.234 


.324 


,383. 


564 


Mp 6 ) 


# 

.025 


# 

.015 


# 

.005 


# 

.003 


if 

.001 


# 

.019 


# 

.013 


# 

.004 


# 

.002 


# 

.002 


# 

.014 


# 

.010 


# 

.004 


# • 
,002. 


# l 

m 






# - indicates negative value 
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TABLE 
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EXAMPLE 



6 



/ 

j 






K= 1000 P Q = .10 

q l = q 2 = * ‘ ‘ = q !000 = - 0009 





a. a 1.0 
1 


a, s 0.8 


a. = 0.6 

l 


N 


5 


10. 


25 


50 


100 


5 


10 


25 50 100 


5 


10 


25 


50 100 


* 

p o 


.104 


.Lp8 


.120 


.140 


.177 


.103 


.106 


.116 


.132 


.162 


.102 


.105 


.112 


.124 


.147 


P 


.104 


.108 


.120 


.140 


.177 


.103 


.106 


.116 


.132 


.162 


.102 


.105 


.112 


.124 


.146 


E(P 3 ) 


.706 


.688 


.680 


.681 


.689 


.585 


.570 


.564 


.565 


.571 


.46' 


.452 


.448 


.449 


.453 


b(P3) 


.602 


.580 


.560 


.541 


.512 


.482 


.464 


.448 


.433 


.409 


.362 


.346 


.336 


.325 


.307 


E(p 5 ) 


.104 


.108 


.120 


.140 


.177 


.103 


.106 


.116 


.132 


.162 


.102 


.105 


.112 


.124 


.146 


b(p s ) 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


e(p 6 ) 


.103 


.107 


.119 


.139 


.177 


.103 


.106 


.115 


.131 


.161 


.102 


.104 


.112 


.123 


.146 




# 

.001 


# 

.001 


.001 


.001 


0 


0 


0 


*• 

.001 


# 

.001 


# 

.001 


0 


# 

.001 


0 


# 

.001 


0 



# - indicates negative value 



TABLE 6 



EXAMPLE 



7 



K = 100 p = .60 

o 

q l = q 2 •• • =q l00 = - 004 





a. H 1.0 
1 


a. - 0.8 

l 


a^ =0.6 


N 


5 


10 


25 


50 


100 


5 


10 


25 50 100 


5 


10 


25 


50 100 


★ 

p o 


<608 


-.615 


.639 


.672 


.733 


.606 


.613 


.631 


.660 


.706 


.605 


•' ' ■; v 

.60S 


.623 


.643 


. 68 C 




,608 


.616 


.638 


.673 


.732 


.606 


.613 


.631 


.658 


.706 


.605 


4 

ytf*; 

.609 


.623 


.644 


.67S 


E(p 3 ) 


871 


.864 


• 

.865 


.872 


.886 


.816 


.811 


.812 


.817 


.829 


,762 


•VA< 

.758 


.759 


.Z63 


,772 


b(p 3 ) 


,263 


.248 


.227 


.199 


.154 


.210 


.198 


.181 


.159 


.123 


.157 


.149 


.136 


.119 


,093 


E(p s ) 


608 


.616 


.638 


.673 


.732 


.606 


.613 


.631 


.658 


.706 


.605 


.609 


.623 


.64.4 


679 


b(p 5 ) 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 , 


0 


0 


E(P 6 ) 


.606 


.614 


.637 


.671 


.731 


.605 


.611 


.629 


.657 


.705 


,604 


.609 


.622 


►643, 


679 


b(P 6 ) 


# 

.002 


# 

.002 


# 

.001 


# 

.002 


.001 


# 

.001 


# 

.002 


# 

.002 


r 

.001 


b 

.001 


# 

,001 


0 


t 

.001 


# 

.ooa 


# 

0 



# - indicates negative value 



TABLE 7 



EXAMPLE 



§ 

4 ' 

s< 



K = 81 P Q = .60 



tl 



V .10 q 2 = ...= q 6 = .03 q ? - . . .- q 3J = .004 cf^ = ...= q 81 = .001 





o 

• 

III 

x <0 


a. h 0.8 


=0.6 


N 


5 


10 


25 


50 


100 


5 


10 


25 50 100 


5 


10 


25 


50 100 


* 

p o 


.66/ 


.710 


.774 


.836 


.879 


.655 


.685 


.741 


.790 


.824 


,644 


.663 


.709 


.742 


,769 


P 


.66^ 


.709 


.784 


.837 


.881 


.651 


.687 


.747 


.790 


.825 


,639 


.665 


.710 


.742 


,768 


E(P^) 


.88c 


.887 


.908 


.928 


.946 


.826 


.830 


.846 


.862 


.877 


.770 


.772 


.785 


.797 


,808 


b(P3) 


.219 


.178 


.124 


.091 


.065 


.175 


.143 


.099 


.072 


.0 52 


.131 


.107 


.075 


.055 


.040 


E(p 5 ) 


.664 


.709 


.784 


.837 


.881 


.651 


.687 


.747 


.790 


.825 


.639 


.66^ 


.710 


.742 


.768 


b(p 5 ) 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


04, 


0 


0 


0 


0 


E(p 6 ) 


.653 


.701 


.780 


.836 


.880 


.643 


.681 


.74-! 


.789 


.824 


.632 


.661 


.708 


.742 


.768 


b(p,) 


# 

.011 


# 

.008 


t 

.004 


t 

.001 


# 

.001 


# 

.008 


# 

.006 


— — or 

o 

♦ °. 


# 

.001 


# 

.001 


# 

.007 


•o* 

o 


It 

.002 


0 


0 



# - indicates negative value 



/V ' 
\f ' 



.'A' 




. . ‘•it! 



TABLE 8 
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EXAMPLE 



K = 100 p = .90 

o 

q i = ••• q ioo = - 001 



• 


a. s i.o 

l 


a. s o.8 
i 


a. = 0.6 

X 


N 


5 


10 


25 


50 


100 


5 


10 


25 50 100 


5 


10 


25 


50 100 


* 

P o 


.900 


.901 


.902 


.905 


.910 


.900 


.901 


.902 


.904 


.907 


.900 


.901 


.902 


.903 


.901 




.900 


.901 


.902 


.905 


.910 


.900 


.901 


.902 


.904 


.908 


.900 


.901 


.901 


.903 


,906 


E(p a ) 


.967 


.'965 


.965 


.965 


.966 


.954 


.952 


.952 


.952 


.953 


.940 


.939 


.939 


.939 


939 


b(P3) 


.067 


.064 


.063 


.060 


.056 


.054 


.051 


.050 


.048 


.045 


,040 


.038 


.038 


.036 


,033 


E(p 5 ) 


.900 


.901 


.902 


.905 


.910 


.900 


.901 


.902 


.904 


.908 


,900 


.901 


.901 


.903 


,906 


b (p 5 ) 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


/ 

0 


E(p 6 ) 


.900 


.901 


.902 


.905 


.090 


.900 


.901 


.902 


.904 


.908 


900 


.901 


.901 


903 


906 


B(P^ 


0 


0 


0 


0 


# 

.001 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 



# - indicates negative value 



TABLE 9 
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